An analysis of reinstatement after extinction of a conditioned taste aversion.

Taste aversion learning has sometimes been considered a specialized form of learning. In several other conditioning preparations, after a conditioned stimulus (CS) is conditioned and extinguished, reexposure to the unconditioned stimulus (US) by itself can reinstate the extinguished conditioned response. Reinstatement has been widely studied in fear and appetitive Pavlovian conditioning, as well as operant conditioning, but its status in taste aversion learning is more controversial. Six taste-aversion experiments with rats therefore sought to discover conditions that might encourage it there. The results often yielded little to no evidence of reinstatement, and we also found no evidence of concurrent recovery, a related phenomenon in which responding to a CS that has been conditioned and extinguished is restored if a second CS is separately conditioned. However, a key result was that reinstatement occurred when the conditioning procedure involved multiple closely spaced conditioning trials that could have allowed the animal to learn that a US presentation signaled or set the occasion for another trial with a US. Such a mechanism is precluded in many taste aversion experiments because they often use very few conditioning trials. Overall, the results suggest that taste aversion learning is experimentally unique, though not necessarily biologically or evolutionarily unique. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Mouse Model of Chronic Social Stress-Induced Excessive Pavlovian Aversion Learning-Memory.

Increased experience of aversive stimuli/events is a psychological-neurobiological state of major importance in psychiatry. It occurs commonly in generalized anxiety disorder, post-traumatic stress disorder, and major depression. A sustained period of exposure to threat (chronic stressor) is a common risk factor, and a major symptom is generalized excessive perception of, and reactivity to, aversive stimuli. In rodents, Pavlovian aversion learning and memory (PAL, PAM), quantified in terms of the conditioned defensive behavior freezing, is an extensively studied behavioral paradigm, and well understood in terms of underlying neural circuitry. In mice, chronic social stress (CSS) is a 15-day resident-intruder paradigm in which C57BL/6 adult males are exposed continuously and distally to dominant-aggressive CD-1 male mice (sustained threat) interspersed with a brief daily period of proximal attack (acute threat). To ensure that physical wounding is minimized, proximal attacks are limited to 30 to 60 s/day and lower incisor teeth of CD-1 mice are blunted. Control (comparison) mice are maintained in littermate pairs. The CSS and CD-1 mice are maintained in distal contact during subsequent behavioral testing. For PAL, CSS and control (CON) mice are placed in a conditioning chamber (context) and exposed to a tone [conditioned stimulus (CS)] and mild, brief foot shock [unconditioned stimulus (US)]. For PAM, mice are placed in the same context and presented with CS repetitions. The CSS mice acquire (learn) and express (memory) a higher level of freezing than CON mice, indicating that CSS leads to generalized hypersensitivity to aversion, i.e., chronic social aversion leads to increased aversion salience of foot shock. Distinctive features of the model include the following: high reproducibility; rare, mild wounding only; male specificity; absence of "susceptible" vs "resilient" subgroups; behavioral effects dependent on continued presence of CD-1 mice; and preclinical validation of novel compounds for normalizing aversion hypersensitivity with accurate feedforward prediction of efficacy in human patients. © 2024 The Authors. Current Protocols published by Wiley Periodicals LLC. Basic Protocol 1: Chronic social stress (CSS) Basic Protocol 2: Pavlovian aversion learning and memory (PALM).

LPS priming-induced immune tolerance mitigates LPS-stimulated microglial activation and social avoidance behaviors in mice.

In this study, we investigated the regulatory mechanisms underlying the effects of LPS tolerance on the inflammatory homeostasis of immune cells. LPS priming-induced immune tolerance downregulated cyclooxygenase-2, and lowered the production of prostaglandin-E2 in microglial cells. In addition, LPS tolerance downregulated the expression of suppressor of cytokine signaling 3, and inducible nitric oxide synthase/nitric oxide; suppressed the LPS-mediated induction of tumor necrosis factor-α, interleukin (IL)-6, and IL-1; and reduced reactive oxygen species production in microglial cells. LPS stimulation increased the levels of the adaptive response-related proteins heme oxygenase-1 and superoxide dismutase 2, and the levels of heme oxygenase-1 (HO-1) enhanced after LPS priming. Systemic administration of low-dose LPS (0.5 mg/kg) to mice for 4 consecutive days attenuated high-dose LPS (5 mg/kg)-induced inflammatory response, microglial activation, and proinflammatory cytokine expression. Moreover, repeated exposure to low-dose LPS suppressed the recruitment of peripheral monocytes or macrophages to brain regions and downregulated the expression of proinflammatory cytokines. Notably, LPS-induced social avoidance behaviors in mice were mitigated by immune tolerance. In conclusion, immune tolerance may reduce proinflammatory cytokine expression and reactive oxygen species production. Our findings provide insights into the effects of endotoxin tolerance on innate immune cells and social behaviors.

Temporal dynamics of costly avoidance in naturalistic fears: Evidence for sequential-sampling of fear and reward information.

Excessive avoidance is characteristic for anxiety disorders, even when approach would lead to positive outcomes. The process of how such approach-avoidance conflicts are resolved is not sufficiently understood. We examined the temporal dynamics of approach-avoidance in intense fear of spiders. Highly fearful and non-fearful participants chose repeatedly between a fixed no spider/low reward and a spider/high reward option with varying fear (probability of spider presentation) and reward information (reward magnitude). By sequentially presenting fear and reward information, we distinguished whether decisions are dynamically driven by both information (sequential-sampling) or whether the impact of fear information is inhibited (cognitive control). Mouse movements were recorded to assess temporal decision dynamics (i.e., how strongly which information impacts decision preference at which timepoint). Highly fearful participants showed stronger avoidance despite lower gains (i.e., costly avoidance). Time-continuous multiple regression of their mouse movements yielded a stronger impact of fear compared to reward information. Importantly, presenting either information first (fear or reward) enhanced its impact during the early decision process. These findings support sequential sampling of fear and reward information, but not inhibitory control. Hence, pathological avoidance may be characterized by biased evidence accumulation rather than altered cognitive control.

Pavlovian-to-instrumental transfer in individuals with chronic pain.

Avoidance of pain has been argued to be key factor leading pain events to chronic disability. In this respect, research has focused on investigating the working mechanisms of avoidance's acquisition. Avoidance of painful stimuli has been traditionally studied using a combination of Pavlovian and Instrumental procedures. However, such approach seems to go against real-life scenarios where avoidance is commonly acquired more readily. Using a novel pain avoidance paradigm, we tested whether pain avoidance can be installed in absence of associations between a cue and pain omission, and whether such avoidance differs between pain patients and healthy controls. Participants first learned to avoid painful stimuli by pressing a grip bar. Then, they passively encountered pairings of one geometrical shape with pain and of another geometrical shape without pain. Lastly, participants encountered the geometrical shapes while being able to use the grip bar. Results showed that participants pressed the bar more vigorously when encountering the previously pain-related shape compared to the pain-unrelated shape. This effect did not seem to differ between pain patients and healthy control. Our study could inspire a new way in measuring avoidance in pain, possibly paving the way to better understanding how avoidance is installed in chronic pain.

The Neural Correlates of Individual Differences in Reinforcement Learning during Pain Avoidance and Reward Seeking.

Organisms learn to gain reward and avoid punishment through action-outcome associations. Reinforcement learning (RL) offers a critical framework to understand individual differences in this associative learning by assessing learning rate, action bias, pavlovian factor (i.e., the extent to which action values are influenced by stimulus values), and subjective impact of outcomes (i.e., motivation to seek reward and avoid punishment). Nevertheless, how these individual-level metrics are represented in the brain remains unclear. The current study leveraged fMRI in healthy humans and a probabilistic learning go/no-go task to characterize the neural correlates involved in learning to seek reward and avoid pain. Behaviorally, participants showed a higher learning rate during pain avoidance relative to reward seeking. Additionally, the subjective impact of outcomes was greater for reward trials and associated with lower response randomness. Our imaging findings showed that individual differences in learning rate and performance accuracy during avoidance learning were positively associated with activities of the dorsal anterior cingulate cortex, midcingulate cortex, and postcentral gyrus. In contrast, the pavlovian factor was represented in the precentral gyrus and superior frontal gyrus (SFG) during pain avoidance and reward seeking, respectively. Individual variation of the subjective impact of outcomes was positively predicted by activation of the left posterior cingulate cortex. Finally, action bias was represented by the supplementary motor area (SMA) and pre-SMA whereas the SFG played a role in restraining this action tendency. Together, these findings highlight for the first time the neural substrates of individual differences in the computational processes during RL.

Impact of single-trial avoidance learning on subsequent sleep.

Both non-rapid eye movement (NonREM) sleep and rapid eye movement (REM) sleep, as well as sleep spindle and ripple oscillations, are important for memory formation. Through cortical EEG recordings of prefrontal cortex and hippocampus during and after an inhibitory avoidance task, we analysed the dynamic changes in the amounts of sleep, spindle and ripple oscillations related to memory formation. The total amount of NonREM sleep was reduced during the first hour after learning. Moreover, significant decrease of the total spindle and ripple counts was observed at the first hour after learning as well. In addition, foot shock alone, with no associated learning, produced little effect on the dynamics of sleep oscillations, indicating that the learning experience is necessary for these changes to occur.

Nucleus accumbens neurons dynamically respond to appetitive and aversive associative learning.

To survive, individuals must learn to associate cues in the environment with emotionally relevant outcomes. This association is partially mediated by the nucleus accumbens (NAc), a key brain region of the reward circuit that is mainly composed by GABAergic medium spiny neurons (MSNs), that express either dopamine receptor D1 or D2. Recent studies showed that both populations can drive reward and aversion, however, the activity of these neurons during appetitive and aversive Pavlovian conditioning remains to be determined. Here, we investigated the relevance of D1- and D2-neurons in associative learning, by measuring calcium transients with fiber photometry during appetitive and aversive Pavlovian tasks in mice. Sucrose was used as a positive valence unconditioned stimulus (US) and foot shock was used as a negative valence US. We show that during appetitive Pavlovian conditioning, D1- and D2-neurons exhibit a general increase in activity in response to the conditioned stimuli (CS). Interestingly, D1- and D2-neurons present distinct changes in activity after sucrose consumption that dynamically evolve throughout learning. During the aversive Pavlovian conditioning, D1- and D2-neurons present an increase in the activity in response to the CS and to the US (shock). Our data support a model in which D1- and D2-neurons are concurrently activated during appetitive and aversive conditioning.

Tackling Costly Fearful Avoidance Using Pavlovian Counterconditioning.

Avoidance behavior constitutes a major transdiagnostic symptom that exacerbates anxiety. It hampers fear extinction and predicts poor therapy-outcome. Pavlovian counterconditioning with a reward could alleviate avoidance better than traditional extinction by reducing negative valence of the feared situation. However, previous studies are scarce and did not consider that pathological avoidance is often costly and typically evolves from an approach-avoidance conflict. Therefore, we used an approach-avoidance conflict paradigm to model effects of counterconditioning on costly avoidance (i.e., avoidance that leads to missing out on rewards). Results from our preregistered Bayesian Mixed Model analyses in 51 healthy participants (43 females) indicated that counterconditioning was more effective in reducing negative valuation and decreasing costly avoidance than traditional extinction. This study supports application of a simple counterconditioning technique, shows that its efficacy transfers to more complex avoidance situations, and suggests treatment may benefit from increasing reward drive in combination with extinction to overcome avoidance. Application in a clinical sample is a necessary next step to assess clinical utility of counterconditioning.

The role of intraamygdaloid oxytocin in spatial learning and avoidance learning.

The goal of the present study is to investigate the role of intraamygdaloid oxytocin in learning-related mechanisms. Oxytocin is a neuropeptide which is involved in social bonding, trust, emotional responses and various social behaviors. By conducting passive avoidance and Morris water maze tests on male Wistar rats, the role of intraamygdaloid oxytocin in memory performance and learning was investigated. Oxytocin doses of 10 ng and 100 ng were injected into the central nucleus of the amygdala. Our results showed that 10 ng oxytocin significantly reduced the time required to locate the platform during the Morris water maze test while significantly increasing the latency time in the passive avoidance test. However, the 100 ng oxytocin experiment failed to produce a significant effect in either of the tests. Wistar rats pretreated with 20 ng oxytocin receptor antagonist (L-2540) were administered 10 ng of oxytocin into the central nucleus of the amygdala and were also subjected to the aforementioned tests to highlight the role of oxytocin receptors in spatial- and avoidance learning. Results suggest that oxytocin supports memory processing during both the passive avoidance and the Morris water maze tests. Oxytocin antagonists can however block the effects of oxytocin in both tests. The results substantiate that oxytocin uses oxytocin receptors to enhance memory and learning performance.

A dedicated hypothalamic oxytocin circuit controls aversive social learning.

To survive in a complex social group, one needs to know who to approach and, more importantly, who to avoid. In mice, a single defeat causes the losing mouse to stay away from the winner for weeks1. Here through a series of functional manipulation and recording experiments, we identify oxytocin neurons in the retrochiasmatic supraoptic nucleus (SOROXT) and oxytocin-receptor-expressing cells in the anterior subdivision of the ventromedial hypothalamus, ventrolateral part (aVMHvlOXTR) as a key circuit motif for defeat-induced social avoidance. Before defeat, aVMHvlOXTR cells minimally respond to aggressor cues. During defeat, aVMHvlOXTR cells are highly activated and, with the help of an exclusive oxytocin supply from the SOR, potentiate their responses to aggressor cues. After defeat, strong aggressor-induced aVMHvlOXTR cell activation drives the animal to avoid the aggressor and minimizes future defeat. Our study uncovers a neural process that supports rapid social learning caused by defeat and highlights the importance of the brain oxytocin system in social plasticity.

Persistent avoidance of virtual food in anorexia nervosa-restrictive type: Results from motion tracking in a virtual stopping task.

OBJECTIVE: Food avoidance is central to patients with anorexia nervosa-restrictive type (AN-R). Competing accounts in experimental psychopathology research suggest that food avoidance may result from automatic, habitual responses or from elevated inhibitory control abilities. This study investigated behavioral trajectories of food avoidance in a novel virtual reality stopping task. METHOD: Sixty patients with AN-R and 29 healthy controls with normal weight were investigated using a novel, kinematic task in virtual reality. We recorded spatial displacement in stop- and go-trials to virtual food and control objects. Inhibitory control abilities were operationalized by the VR task in stopping performance (i.e., interrupted movement in stop-trials), whereas we also measured habitual avoidance of virtual food across both go- and stop-trials (i.e., delayed movement relative to nonfood objects). RESULTS: In patients with AN-R, hand displacements were shorter to food versus nonfood across stop- and go-trials, reflected in a Stimulus × Group interaction. Healthy controls showed no differences. Importantly, the food-specific effect in AN-R was identical across stop- and go-trials, indicating habitual food avoidance. Moreover, stop error rates (i.e., stop-trials with response) were lower in patients with AN-R. DISCUSSION: The findings suggest food-specific habitual avoidance and heightened generalized inhibitory control in AN-R. The continuously delayed displacements during active hand movements across stop- and go-trials indicated the persistence of patients' avoidance of food. PUBLIC SIGNIFICANCE: Experimental research investigates the mechanisms underlying mental disorders such as anorexia nervosa. In this study, we measured interrupted hand movements in response to food pictures or neutral pictures (shoes) in patients with anorexia nervosa and healthy controls. A virtual reality scenario was used. Findings indicated that patients were slower at approaching food, interrupted or not. Key mechanisms of food avoidance can be translated into habit-based treatment options in future research.

The COVID-19 pandemic and changes in social behavior: Protective face masks reduce deliberate social distancing preferences while leaving automatic avoidance behavior unaffected.

Protective face masks were one of the central measures to counteract viral transmission in the COVID-19 pandemic. Prior research indicates that face masks impact various aspects of social cognition, such as emotion recognition and social evaluation. Whether protective masks also influence social avoidance behavior is less clear. Our project assessed direct and indirect measures of social avoidance tendencies towards masked and unmasked faces in two experiments with 311 participants during the first half of 2021. Two interventions were used in half of the participants from each sample (Experiment 1: protective face masks; Experiment 2: a disease prime video) to decrease or increase the salience of the immediate contagion threat. In the direct social avoidance measure, which asked for the deliberate decision to approach or avoid a person in a hypothetical social encounter, participants showed an increased willingness to approach masked as opposed to unmasked faces across experiments. This effect was further related to interindividual differences in pandemic threat perception in both samples. In the indirect measure, which assessed automatic social approach and avoidance tendencies, we neither observed an approach advantage towards masked faces nor an avoidance advantage for unmasked faces. Thus, while the absence of protective face masks may have led to increased deliberate social avoidance during the pandemic, no such effect was observed on automatic regulation of behavior, thus indicating the relative robustness of this latter behavior against changes in superordinate social norms.

Neurotrophin-3 into the insular cortex strengthens conditioned taste aversion memory.

Memory consolidation is an essential process of long-term memory formation. Neurotrophins have been suggested as key regulators of activity dependent changes in the synaptic efficacy and morphology, which are considered the downstream mechanisms of memory consolidation. The neurotrophin 3 (NT-3), a member of the neurotrophin family, and its high affinity receptor TrkC, are widely expressed in the insular cortex (IC), a region with a critical role in the consolidation of the conditioned taste aversion (CTA) paradigm, in which an animal associates a novel taste with nausea. Nevertheless, the role of this neurotrophin in the cognitive processes that the IC mediates remains unexamined. To answer whether NT-3 is involved in memory consolidation at the IC, adult male Wistar rats were administered with NT-3 or NT-3 in combination with the Trk receptors inhibitor K252a into the IC, immediately after CTA acquisition under two different conditions: a strong-CTA (0.2 M lithium chloride i.p.) or a weak-CTA (0.1 M lithium chloride i.p.). Our results show that NT-3 strengthens the memory trace of CTA, transforming a weak conditioning into a strong one, in a Trk-dependent manner. The present evidence suggests that NT-3 has a key role in the consolidation process of an aversive memory in a neocortical region.

Prefrontal Regulation of Safety Learning during Ethologically Relevant Thermal Threat.

Learning and adaptation during sources of threat and safety are critical mechanisms for survival. The prelimbic (PL) and infralimbic (IL) subregions of the medial prefrontal cortex (mPFC) have been broadly implicated in the processing of threat and safety. However, how these regions regulate threat and safety during naturalistic conditions involving thermal challenge still remains elusive. To examine this issue, we developed a novel paradigm in which adult mice learned that a particular zone that was identified with visuospatial cues was associated with either a noxious cold temperature ("threat zone") or a pleasant warm temperature ("safety zone"). This led to the rapid development of avoidance behavior when the zone was paired with cold threat or approach behavior when the zone was paired with warm safety. During a long-term test without further thermal reinforcement, mice continued to exhibit robust avoidance or approach to the zone of interest, indicating that enduring spatial-based memories were formed to represent the thermal threat and thermal safety zones. Optogenetic experiments revealed that neural activity in PL and IL was not essential for establishing the memory for the threat zone. However, PL and IL activity bidirectionally regulated memory formation for the safety zone. While IL activity promoted safety memory during normal conditions, PL activity suppressed safety memory especially after a stress pretreatment. Therefore, a working model is proposed in which balanced activity between PL and IL is favorable for safety memory formation, whereas unbalanced activity between these brain regions is detrimental for safety memory after stress.

Top-down control of flight by a non-canonical cortico-amygdala pathway.

Survival requires the selection of appropriate behaviour in response to threats, and dysregulated defensive reactions are associated with psychiatric illnesses such as post-traumatic stress and panic disorder1. Threat-induced behaviours, including freezing and flight, are controlled by neuronal circuits in the central amygdala (CeA)2; however, the source of neuronal excitation of the CeA that contributes to high-intensity defensive responses is unknown. Here we used a combination of neuroanatomical mapping, in vivo calcium imaging, functional manipulations and electrophysiology to characterize a previously unknown projection from the dorsal peduncular (DP) prefrontal cortex to the CeA. DP-to-CeA neurons are glutamatergic and specifically target the medial CeA, the main amygdalar output nucleus mediating conditioned responses to threat. Using a behavioural paradigm that elicits both conditioned freezing and flight, we found that CeA-projecting DP neurons are activated by high-intensity threats in a context-dependent manner. Functional manipulations revealed that the DP-to-CeA pathway is necessary and sufficient for both avoidance behaviour and flight. Furthermore, we found that DP neurons synapse onto neurons within the medial CeA that project to midbrain flight centres. These results elucidate a non-canonical top-down pathway regulating defensive responses.

Aversive conditioning is impaired in impulsive individuals: A study on learning asymmetries.

BACKGROUND AND OBJECTIVES: Appetitive and aversive conditioning are thought to be involved in the development and maintenance of mental disorders including anxiety, mood, eating, and substance use disorders. However, few studies measure the relative strength of appetitive and aversive associations, and their relevance to the risk of mental disorders. This study aims to address this gap. METHODS: We tested how readily healthy volunteers acquire appetitive vs. aversive associations. 150 participants associated complex 3D objects with either gain or loss and made decisions to gain or avoid losing points. We investigated the relationship of a learning asymmetry with neuroticism, impulsivity, and anhedonia, to test the hypothesis that a stronger learning asymmetry corresponds to more extreme scores on these traits. RESULTS: Impulsivity was positively associated with the learning asymmetry (R2 = .10). This resulted from an inverse relation with the strength of aversive associations, indicating that impulsive individuals are worse at aversive learning. However, appetitive associations did not differ significantly. No correlations with neuroticism or anhedonia were found. LIMITATIONS: Conditioning studies typically use primary reinforcers and a CS-. Lacking these may make these results less comparable to other studies. CONCLUSIONS: We demonstrate that the learning asymmetry can measure individual differences linked to personality traits, and that impulsivity, normally linked with appetitive learning, also influences aversive learning. These results enable additional studies of learning asymmetry in relation to mental disorders, which could include measurements of mental health symptoms to provide further insight into how appetitive and aversive learning interacts with mental disorders.

Characterization of taste sensitivities to amino acids and sugars by conditioned taste aversion learning in chickens.

Taste plays an essential role in regulating the feeding behaviors of animals. The present study aimed to characterize the taste sensory profiles of amino acids and sugars in chickens. To achieve this, we employed a conditioned taste aversion learning method, which is characterized by a specific pairing of gastrointestinal malaise and taste perception. Our findings revealed that chickens were able to learn to avoid L-Val, L-Lys, and L-His through conditioned taste aversion learning, and exhibited a strong aversion to L-Arg. These results suggest that chickens are primarily sensitive to basic amino acids, including L-Lys, which is a crucial limiting amino acid in feeds. Interstingly, this sensitivity to basic amino acids in chickens contrasts with humans, who are mainly sensitive to acidic amino acids as umami taste. Furthermore, despite the absence of a mammalian sweet taste receptor gene in the chicken genome, we demonstrated that chickens learned to avoid glucose, galactose, sucrose, and maltose by conditioned taste aversion learning. Taken together, the present study provides the idea that chickens possess a gustatory perception toward specific amino acids and sugars for the detection of beneficial nutrients in their feeds.

Dopamine D2 receptors in WFS1-neurons regulate food-seeking and avoidance behaviors.

The selection and optimization of appropriate adaptive responses depends on interoceptive and exteroceptive stimuli as well as on the animal's ability to switch from one behavioral strategy to another. Although growing evidence indicate that dopamine D2R-mediated signaling events ensure the selection of the appropriate strategy for each specific situation, the underlying neural circuits through which they mediate these effects are poorly characterized. Here, we investigated the role of D2R signaling in a mesolimbic neuronal subpopulation expressing the Wolfram syndrome 1 (Wfs1) gene. This subpopulation is located within the nucleus accumbens, the central amygdala, the bed nucleus of the stria terminalis, and the tail of the striatum, all brain regions critical for the regulation of emotions and motivated behaviors. Using a mouse model carrying a temporally controlled deletion of D2R in WFS1-neurons, we demonstrate that intact D2R signaling in this neuronal population is necessary to regulate homeostasis-dependent food-seeking behaviors in both male and female mice. In addition, we found that reduced D2R signaling in WFS1-neurons impaired active avoidance learning and innate escape responses. Collectively, these findings identify a yet undocumented role for D2R signaling in WFS1-neurons as a novel effector through which dopamine optimizes appetitive behaviors and regulates defensive behaviors.